AD-A216  607 


W  FILE  COPT 


UN  CLASS  IFIH) 


KASTIR  COPT 


FOR  RSPROO'JCTIOK  PURPOSEJ 


'■IwAmON 


U.  REPORT  SECURITY  C.ASSinCATION 
i*.  SECURITY  Cu^SlPlCATiON  AUTHORITY 


REPORT  DOCUMENTATION  PAGE 

i  le.  RESTRICTIVE  MARRINCS 


^  ^^MENT  K 

Appiovdd  foi  public  leleoBRi 
Di*  • 


.  MONTTORlNG  organ: 


I  in.  oeClASSIpication  /  OOWNCRAOING  SCHEOuU  I  Approved  fox  public 

I  I  Die 


4.  PERFORMING  organization  REPORT  NUMfiERIS) 

M.I.T.  LIDS-P-1929 

6«.  name  Or  PERFORMING  ORGANIZATION  «e.  OFFICE  SYMBO;.  7*.  NAME  OF  MONITORING  ORGANIZATION 
M .  I .  T  .  (tf  *fiolic»bi«) 

Lab.  for  Inform,  and  Dec.Syst<ms  Office  of  Naval  Research 


6c.  address  (Gry,  Sure,  *nd  Zif  Coat) 
M.I.T. 

Room  35-406,  LIDS 
Cambridge,  MA  02139 


Ba.  name  of  funding /SPONSORING 
organization 


Sc  address  (Ory.  itatt.  and  ZIP  Coat) 


7b.  ADDRESS  <CiY,  Stare,  and  ZIP  Coot) 
800  N.  Quincy  Street 
Arlington,  VA  22217-5000 


8b.  OFSiCE  SYMBOL  S.  PROCUREMENT  INSTRUMENT  IDENTIFICATION  NUMBER 
(If  aooiicaait)  > 


1  10.  SOURCE  OF  FUNDING  NUMBERS  _ 


unciuat  itcunry  uaiuncation) 

DISTRIBUTED  DETECTION  BY  A  LARGE  TEAM  OF  SENSORS  IN  TANDEM 


1 

PROGRAM 

PROJECT 

task 

IWORK  unit 

ELEMENT  NO. 

NO. 

NO. 

accession  no 

'.1 

12.  personal  auTHORIS) 

J.D.  Papastavrou  and  Michael  Athens 


13a.  'YPE  Or  REPORT 
Paper 


13b.  time  covered 

FROM  TO 


14.  DATE  OF  REPORT  (Yean  Month.  Dayl  pS.  PAGE  COUNT 

89/11/1  32 


16.  SUPPLEMENTARY  NOTATION 


18.  jwrr  •.•.iviiiB  I  .  iHW*MUwni 

Tne  view,  opini  ns  aad/or  iisdings  contained  in  this  report  are  those 
sTF^DorCs)  .and  should  not  .be ,  ttnstrued  as.  an  official  Department  of  the  Anav  position. 


COSATI  CODES  18.  SUBJECT  TER.VS  ICominut  on  rtvtrtt  if  ntnssary  ana  laenrify  oy  oiock  numotr) 

field  I  GROUP  I  SUB-GROUP 


*9.  ABSTRACT  (Continue  on  rtvtrtt  if  ntttaary  and  tatrrafy  Oy  otocK  numotr) 

Abstract  The  probletn  of  decentralized  binary  hypothesis  testing  by  a  team  consiinng  of  N 
decision  makeis  (DMs)  in  andem  is  considered.  Each  DM  receives  an  observanon  and  transmits  a 

binaiy  message  to  its  successor,  the  last  DM  has  to  decide  which  hypothesis  is  true.  Necessary  and 

sufficient  conditions  are  derived  for  the  probability  of  eiror  to  asymptotically  (as  N-r-)  go  to 
zero.  The  result  is  generalized  for  multiple  hypotheses  and  multiple  messages.  An  easily 
implementable  subopdmal  decision  scheme  is  also  consideied;  necessary  and  sufficient  conditions 
for  the  probability  of  error  to  asymptotically  go  to  zero  are  derived  for  this  case  as  well.  The  trade 
off  between  the  complexity  of  the  decision  rules  and  their  performance  is  examined  and  numerical 
results  are  presented. 


^  1^0 


ZE.  distribution /AVAI^BILITY  of  AsSTRaCT 
^  UNCIASSIP'ED/UMIMITEO  ^  SAME  AS  R 


abstract  security  c-assification 
Unclassif isd 


PrONE  linciuot  Arta  Coat/  :  L 


D  D  P  V  R  w  *  -  /  3  .  Si  .V  Ar 


sj  --n  e:'’:o — ;*v  be  -\e:  ■  e»p.».:Te: 

F-ii  ctie-  ec  :;op.i  j'«  csioiete 


9  0  01  TO  138 


November  1989 


LIDS-P-1929 


Distributed  Detection  by  a  Large  Team  of  Sensors  in  Tandem  ^ 


Jason  D.  Papastavrou  and  Michael  Athans  ^ 


0 


Abstract.  The  problem  of  decentralized  binary  hypothesis  testing  by  a  team  consisting  of  N 

decision  makers  (DMs)  in  tandem  is  considered.  Each  DM  receives  an  observaticm  and\transmits  a 

\ 

binary  message  to  its  successor,  the  last  DM  has  to  decide  which  hypothesis  is  true.  Necessary  and 
sufficient  conditions  are  derived  for  the  probability  of  error  to  asymptotically  (as  go  to 

zero.  The  result  is  generalized  for  multiple  hypotheses  and  multiple  messages.  An  easily 
implementable  suboptimal  decision  scheme  is  also  considered;  necessary  and  sufficient  conditions 
for  the  probability  of  error  to  asymptotically  go  to  zero  are  derived  for  this  case  as  well.  The  trade 
off  between  the  complexity  of  the  decision  rules  and  their  performance  is  examined  and  numerical 
results  are  presented. 
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1.  INTRODUCTION  AND  MOTIVATION 

Despite  the  considerable  research  interest  on  distributed  decision  making  in  a  hypothesis 
testing  environment,  almost  all  the  results  focus  on  small  teams.  The  explosive  combinatorial 
complexity  of  the  problems  in  this  framework  suggests  that  only  simple  and  very  restricted 
architectures  of  large  organizations  can  be  analyzed.  The  infinite  parallel  organization  was 
considered  in  [T88].  In  this  paper  the  infinite  tandem  architecture,  the  other  limit  case,  is  analyzed. 

There  exist  two  main  reasons  which  motivated  our  research.  First,  it  is  desirable  to  determine 
under  what  conditions  the  probability  of  error  of  the  infinite  tandem  team  (organization)  goes  to 
zero.  Then,  it  is  also  interesting  to  examine  the  behavior  of  the  members  of  a  team  when  a  change 
in  the  architecture  of  the  team  occurs.  It  is  known  that  if  a  new  DM  is  added  to  a  team,  all  the  DMs 
have  to  modify  their  decision  rules  to  adapt  to  the  new  architecture;  this  requires  that  the  problem 
be  solved  again  from  the  beginning  for  the  new  architecture.  For  this  reason,  we  introduce  a 
suboptimal  decision  scheme  which  is  considerably  more  simple  to  implement,  under  which,  each 
DM  tries  selfishly  to  maximize  the  performance  of  its  own  personal  decision  instead  of  the  global 
team  performance.  One  can  make  an  argument  that  this  decision  scheme  is  more  descriptive  of 
human  organizations  than  the  optimal  decision  scheme,  since  human  DMs  are  reluctant  to  sacrifice 
their  individual  performance  for  the  good  of  the  organization. 

The  suboptimal  decision  scheme  can  be  easily  adapted  to  account  for  changes  in  the  team 
architecture;  it  will  not  yield  optimal  performance,  but  will  provide  a  descriptive  flavor  of  the  team 
dynamics.  Moreover,  it  provides  an  upper  bound  on  the  optimal  team  probability  of  error,  which  is 
also  bounded  from  below  by  the  probability  of  error  of  the  centralized  team.  For  all  the  above 
reasons,  the  proposed  suboptimal  decision  scheme  is  extensively  analyzed;  conditions  for  the 
probability  of  error  of  the  infinite  team  to  go  to  zero,  when  this  scheme  is  implemented,  are  derived 
and  its  performance  is  compared  to  the  optimal  team  performance. 

The  sequential  (tandem)  decentralized  problem  is  defined  as  follows.  As  shown  in  Figure  1, 

the  team  consists  of  N  DMs  and  there  are  M  hypotheses  Ho . with  known  prior 

probabilities  P{Hi)  >  0.  Let  the  observation  of  the  nth  DM,  n  =  1, ...,  N,  be  a  random  variable 
taking  values  from  a  set  Y.  The  y^'s  are  conditionally  independent  and  identically  distributed  given 
any  hypothesis,  with  a  known  probability  distribution  P{y  I  Hi),  /  =  1, ...,  M.  Let  D  be  &  positive 
integer.  The  first  DM  evaluates  a  D-valued  message  ui  based  on  its  own  observation  and  transmits 
it  to  its  successor,  that  is,  ui  =  TiCVi),  where  Y'-^[  1, ...,  D)  is  a  mearurable  function.  Each 
subsequent  DM  evaluates  a  D-valued  message  Un  based  on  its  own  observation  yn  and  on  the 
message  u^\  from  its  predecessor  and  transmits  it  to  its  successor;  that  is,  *  ){,(y„,  u^i)  where 
the  measurable  function  "in-  1, ...,  D)-»{1, ...,  D)  is  called  the  decision  rule  of  DM  n.  The 
decision  ujv  of  the  final  DM  N  is  the  team  decision  and  declares  one  of  the  hypotheses  to  be  true. 

\ti 


3 


The  objective  is  to  choose  the  decision  rules  ^  which  minimize  the  probability  of  error  of 
the  decision  of  DM  N. 

yi  yz  yji^i  y» 


Figure  1.  The  Team  Consisting  of  N  DMs  in  Tandem 


Many  results  have  focused  on  similar  problems  with  small  teams  and  small  number  of 
messages  [ET82],  [TV87],  [R87],  [TP89].  As  mentioned  above,  in  [T88]  asymptotic  results  were 
obtained  for  the  parallel  team,  where  all  DMs  transmit  a  message  to  a  fusion  center  which  makes 
the  final  team  decision.  We  can  easily  obtain  that,  given  the  conditional  independence  assumption 
for  the  observations,  the  optimal  decision  rule  of  each  DM  (except  the  first  one)  is  given  in  the 
form  of  likelihood  ratios  with  DM{M  -  l)/2  constant  thresholds.  These  thresholds  can  be  obtained 
by  examining  all  the  solutions  of  a  set  of  coupled  algebraic  equations  which  are  usually  very  hard 
to  solve.  Comparison  with  our  results  indicates  that  the  parallel  architecture  asymptotically 
performs  better  than  the  tandem  architecture,  contradicting  the  claims  in  [VT88]  where  each  sensor 
employed  the  Neyman-Pearson  test  Note  also  that  if  the  conditional  independence  assumption 
fails,  the  optimal  decision  rules  do  not  have  to  be  given  by  likelihood  ratio  tests  and  the  problems 
are  computationally  intractable  (NP-hard)  even  for  small  values  of  N  and  D  [TA85]. 

For  the  parallel  team  it  is  known  that  the  probability  of  eiror  goes  very  quickly  to  zero,  for  any 
logical  choise  of  decision  rules.  We  would  like  to  determine  whether  the  probability  of  error  for  the 
tandem  team  goes  asymptotically  to  zero.  In  the  next  section  we  obtain  necessary  and  sufficient 
conditions  for  this  for  the  case  of  binary  hypotheses  {M  =  2)  and  binary  messages  (D  =  2)  and  in 
the  following  section  we  generalize  the  result.  In  section  4  we  introduce  the  suboptimal  "selfish" 
decision  scheme  which  is  very  easily  computable  and  derive  necessary  and  sufficient  conditions  for 
the  probability  of  error  to  asymptotically  go  to  zero.  Finally,  in  section  5  we  compare  the 
performances  of  the  optimal  and  suboptimal  decision  schemes  and  try  to  establish  the  trade  off 
between  the  performance  and  the  computational  complexity  of  the  decision  rules. 

Notation.  UJ  denotes  the  integer  part  of  x  and  fjcl  denotes  the  smallest  integer  greater  than  or 
equal  to  x. 
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2.  THE  OPTIMAL  INnNITE  TANDEM  TEAM 

We  consider  the  case  of  binary  hypothesis  testing  {M  =  2)  and  binary  communication 
messages'^  (D  =  2).  In  this  case  each  DM  or  team  of  DMs  can  be  expressed  by  its  Receiver 
Operating  Characteristic  (ROC)  curve;  this  curve  usually  given  in  the  form  of  two  parametric 
equations  is  a  representation  of  the  probability  of  detection  Pp  (=  P(u  =  1 1  //i) )  of  the  DM  or  team 
of  DMs  as  a  function  of  the  probability  of  false  alarm  Pp  (=  P{u  =  1  I  //©)  )  and  has  many 
interesting  properties  [V68].  The  probability  of  error  of  a  tandem  team  consisting  of  N  DMs  is 
defined  as  follows: 


P^{N)  =  P{Hq)  Pf  +  P{Hi)  {\-Pd) 


(1) 


Consider  the  team  which  consists  of  N  DMs  in  tandem  and  performs  binary  hypothesis 
testing.  Given  some  prior  probabilities  (hence  also  some  i)  -  P(Ho)/PiHi) ),  we  generalize  the 
results  of  [E82],  as  in  [R87],  and  obtain  the  necessary  conditions  for  the  optimal  decision  rules  of 
the  DMs  as  a  set  of  likelihood  ratio  tests  with  constant  thresholds: 


Ml=l 

^(yi)  ^ 

ui*0 


P{UN=  1 1  \,Hq)-'P(mn-  1  I  0>  //q) 
P{UN^  1 1  «1=  1,  //i)  -/»(ma,=  1  I  0.  HO 


(2) 


and: 


Un=  1 

^(yn)  ^ 

Un=0 


PiUN=  1  I  Un=  1.  Hq)  -  P{Uff=  1  I  Uw=  0.  Hq)  PiMn-\-  i  \  Hq)  _ 

PiUN=  1 1  W«=  1,  HO  -  P{UN=  1  I  ««=  0,  HO  P(m«-i=  i\H0  '  ” 

for  rt  =  2.  3 . N-\  and  /  =  0,  1  (3) 


UN=  1 
un=0 


PiuN.i=i\Ho) 

P{.UN-i=^i\H0 


for  j  =  0,  1 


(4) 


^  The  two  messages  which  each  DM  is  able  to  transmit  can  be  denoted  mi  and  m2.  Without  loss  of  generality 
assume  that: 

m  I  Hq)  ^  Pjuri^  m2 1  Hq) 

/’(ii«*mi  I//1)  /*(»fi=m2l//i) 

Suppose  that  DM  n  receives  an  observation  if  DM  «’s  optimal  decision  is  m/  when  he  rec  ;ives  Un_i»  mj , 

then  it  can  be  shown  that  his  optimal  decision  is  again  when  he  receives  m;  (for  «  »  2,  3 . AO- 

Moreover,  if  DM  A/'s  optimal  decision  is  1  (0)  when  he  receives  u^-i*  mi  (m2),  then  it  can  be  shown  that  his 
optimal  decision  is  again  uiv  ■  1  (0)  when  he  receives  u^-i*  m2  (mi).  Then  backtracking  it  can  be  seen  that  mi  is 
interpreted  as  0  and  m2  is  interpreted  as  1. 
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We  will  now  demonstrate  that  the  optimal  probability  of  error  of  the  infinite  tandem  team  does 
not  necessarily  have  to  be  zero.  For  this,  we  will  present  a  special  R(X^  curve  for  the  individual 
DM  and  we  will  calculate  inductively  the  ROC  curve  of  the  team  consisting  of  N  such  DMs  in 
tandem;  this  in  general  can  not  be  done  analytically.  We  will  then  take  the  limit  of  the  team  ROC 
curve  as  N-*  <»  and  show  that  the  team  probability  of  error  is  bounded  away  from  zero. 

Therefore,  consider  the  DM  whose  ROC  curve  is  presented  in  Figure  2,  for  some  a  >  1  (the 
underlying  probability  distributions  are  presented  in  Table  1).  An  example  of  a  DM  with  such  a 
ROC  curve  is  a  person,  who  observes  the  outcomes  of  the  tosses  of  a  coin  known  to  be  a  to  1 
biased  in  favor  of  the  most  likely  outcome,  and  tries  to  decide  whether  die  coin  is  biased  in  favor  of 
'heads'  or  in  favor  of  'tails'.  We  start  by  obtaining  the  ROC  curve  of  a  team  which  consists  of  N 
such  DMs. 


Pf 

Figure  2.  A  Special  ROC  Curve 


LEMMA  1.  Consider  the  tandem  team  which  consists  ofN  ^  2  identical  DMs;  suppose  that  the 
ROC  curve  of  each  DM  is  given  in  Figure  2.  Then  the  team  ROC  curve  consists  of  the  following 
2N  points: 


(Pf,P^  =  (0,0) 


■ 

V  +  2-2>  Y" 

/  a  y 

I  ff  y 

V  +  2-2J 

/  a  y 

1/ 

i  =  0 

((a+l)4’ 

i-0 

l(a+  1)2 )_ 

for  ;•=  1,  2, 


a 

.21 


(5a) 


(5b) 
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Table  1.  Probability  Distributions  for  DM  of  Figure  2 


The  proof  is  by  induction  on  N.  We  consider  the  cases  of  N  odd  and  N  even  separately  and  then 
combine  the  results  to  obtain  (5).  The  detailed  proof  is  presented  in  the  appendix.  Note  that  since 
the  RCXr  curve  of  the  individual  DM  is  symmetric,  the  team  RCX!^  curve  is  also  symmetric. 

We  use  Lemma  1  to  obtain  the  ROC  curve  of  the  infinite  team  which  consists  of  identical  DMs 
whose  ROC  curve  is  given  in  Figure  2. 
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LEMMA  3.  The  ROC  curve  of  an  infinite  tandem  team  of  identical  DMs  whose  individual  ROC 
curve  is  given  in  Figure  2  consists  of  the  following  points: 


((-■1  y _ 1 _  (-g_y _ al _ ) 

\'a+l'  a^  +  a+l  '  a^  +  a+l* 

1  _  (,-g  y _ ai _  1 

la+li  +  ' 


(-L_y - 1 - 

for  i  =  0,  1,  2, 


(7a) 

(7b) 


To  prove  Lemmas  2  and  3,  we  consider  the  cases  of  N  odd  and  even,  take  the  limits  and  show 
that  they  are  equal.  The  detailed  proofs  are  presented  in  the  appendix.  From  above  the  Lemmas,  we 
derive  the  following  two  interesting  corollaries. 

COROLLARY  1.  Consider  the  irfinite  tandem  team  of  identical  DMs  whose  ROC  curve  is 
given  in  Figure  2.  Suppose  that  the  prior  probabilities  of  both  hypotheses  are  equal.  Then  the 
optimal  probability  of  error  for  the  team  is: 

/.«(oo)  =  O.S<X+l  (g) 

+  a  +  1 


Proof.  From  basic  detection  theory  [V68]  it  is  known  that  the  optimal  operating  point  is  the 
point(s)  of  the  ROC  curve  at  which  the  slope  of  the  tangent  to  the  ROC  curve  is  77  =  P{Hq)/P{H\)  - 
1.  If  the  ROC  curve  is  not  differentiable  (and  thus  a  tangent  to  it  does  not  exist  everywhere)  the 
optimal  operating  point  is  the  point(s)  of  the  curve  which  fost  intersects  a  line  of  slope  77  moving 
down  the  Pd  axis.  From  Lemma  3  we  can  see  that  any  point  in  the  line  segment  between 
{P^~  ^  P^~  ^)  and  iPp, Pp)  is  such  a  point  Then,  substitute  for  the  limit  of  iPp~^,  Pq~  *) 
from  (3)  into  (1),  the  definition  of  the  probability  of  error,  and  the  corollary  is  proved.  Q.E.D. 

REMARK:  If  T7  =  1,  the  above  infinite  tandem  team  improves  on  the  performance  of  an  individual 
DM  by  a  factor  of: 

/**("»)  ^  (0.5g-t-l)(a-f  1) 

/’'(I)  ~  a2  +  a+l 

Thus  the  probability  of  error  of  the  infinite  tandem  team  will  be  between  50%  and  100%  of  the 
probability  of  error  of  an  individual  DM.  Furthermore  as  llog(77)l  increases  the  improvement  on  the 
performance  is  even  less  significant.  These  facts  should  suggest  the  inefficiencies  of  the  tandem 
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architecture.  As  the  number  of  DMs  in  an  organization  increases  the  team  should  expand  more  in  a 
parallel  than  in  tandem  since  the  contribution  of  DMs  which  are  positioned  at  the  low  levels  in  the 
chain  of  command  seems  to  be  insignificant. 

CORROLARY  2.  The  probability  of  error  of  an  infinite  tandem  team  does  not  have  to  be  zero. 

Since  the  probability  of  error  of  an  infinite  tandem  team  could  be  bounded  away  fiom  zero,  we 
present  necessary  and  sufficient  conditions  on  the  ROC  curve  of  the  individual  DM  for  this  to 
happen. 

PROPOSITION  1.  Consider  a  tandem  team  which  consists  ofN  identical  DMs  and  performs 
binary  hypothesis  testing.  Then,  as  N-*  «>,  the  team  will  achieve  zero  probability  of  error  w.p.l, 
for  any  prior  probabilities,  if  and  only  if  either  the  initial  slope  of  the  ROC  curve  of  the  individual 
DM  is  infinite  or  its  final  slope  is  zero. 

Proof.  To  prove  the  only  if  pan,  suppose  that  the  initial  slope  of  the  ROC  curve  of  the  individual 
DM  is  mo  <  “  and  that  the  its  final  slope  is  mi  >  0.  Denote:  a  =  max  {mo,  1/mi } .  Then  because 
of  the  concavity  of  the  ROC  curve,  each  DM  of  the  team  is  worse  than  a  DM  having  a  two  piece- 
wise  ROC  curve  whose  first  piece  has  slope  a  and  whose  second  piece  has  slope  1/a  (Figure  2). 
By  the  Lemma  3,  an  infinite  tandem  team  consisting  of  such  (better)  DMs  will  have  a  non-zero 
probability  of  error.  Therefore  the  infinite  tandem  team  consisting  of  the  original  (worse)  DMs  will 
also  have  non- zero  probability  of  error. 

To  prove  the  if  part,  suppose  without  loss  of  generality  (since  the  names  of  the  two 
hypotheses  can  be  interchanged)  that  mo  = «».  The  proof  consists  of  proposing  decision  rules  (not 
necessarily  optimal)  for  the  DMs  of  the  team  which  will  result  in  a  zero  asymptotic  probability  of 
error,  that  is,  it  will  be  shown  that  given  any  S  such  that  1  >  5  >  0,  if  the  proposed  decision  rules 
are  employed,  the  probability  of  error  can  be  made  less  than  8  as  N-*  «>.  The  detailed  proof  is 
presented  in  the  appendix.  Q.E.D. 

This  is  a  useful  result  because  it  offers  a  convenient  test  involving  only  the  individual  team 
member,  in  order  to  determine  whether  the  infinite  team  probability  of  error  is  bounded  away  from 
zero  or  not.  Moreover,  after  the  proof  was  completed,  it  was  communicated  to  us  by  J.N. 
Tsitsiklis  that  similar  results  had  been  established  in  the  context  of  automata  with  finite  memory 
[C69],  [HCT/O].  There,  a  finite  Markov  chain  was  considered,  with  the  additional  restriction  that 
the  transition  probabilities  be  time  invariant;  each  state  of  this  chain  corresponded  to  a  discrete 
hypothesis  and  conditions  for  the  convergence  of  the  chain  to  a  unique  (true)  state  were  obtained. 
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3.  INTERPRETATIONS  AND  GENERALIZATIONS 

Let  A(  )  denote  the  likelihood  ratio  of  y  e  T  the  observation  of  each  individual  DM  and  A(Y) 
denote  the  range  of  its  possible  values.  Then,  Proposition  1  can  also  be  stated  in  the  following 
equivalent  fonn: 

PROPOSITION  la.  The  infinite  tandem  team  probability  of  error  is  bounded  way  from  zero, 
for  any  prior  probability,  if  and  only  f  there  exists  some  B>0  such  that: 

\log[A(Y)]\<B. 

We  would  like  to  elaborate  on  these  necessary  and  sufficient  conditions.  For  this  consider  a 
single  DM  who  receives  measurements  serially  and  who  has  limited  memory  so  that  it  can  only 
recall  the  last  <Mie  received.  Then  the  conditions  in^ly  that  if  this  DM  is  willing  to  wait  iMig  enough 
before  making  its  decision,  it  can  achieve  any  desirable  level  of  performance.  On  the  other  hand,  if 
the  conditions  do  not  hold  the  likelihood  ratio  of  an  individual  DM  is  bounded.  This  implies  that 
there  exists  some  DM  (N*+l)  of  the  team  whose  measurement  does  not  influence  its  decision, 
because  the  decision  Myv*  is  so  reliable  that  it  is  propagated  as  regardless  of  y\*+i;  since  all 
the  DMs  are  identical,  will  be  more  reliable  than  the  measurement  of  each  subsequent  DM  and, 
will  evenmally  become  the  final  team  decision  as  well.  Thus  only  the  measurements  of  the  first  N* 
DMs  influence  the  team  decision  and  since  a  finite  number  of  measurements  results  in  a  non- zero 
probability  of  error  even  in  the  centralized  case,  the  optimal  team  probability  of  error  will  be 
bounded  away  from  zero. 

It  is  worthwhile  to  compare  the  conditions  of  Proposition  1  to  the  conditions  in  |T88]  for  the 
DMs  of  the  infinite  parallel  team  to  have  identical  optimal  decision  rules.  The  conditions  are 
"opposite"  in  the  sense  that  the  conditions  in  |T88]  require  that  a  single  DM  is  not  able  to  make  a 
perfectly  accurate  decision,  while  our  conditions  require  that  a  single  DM  is  able  to  make  a  decision 
satisfying  any  given  level  of  accuracy. 

Consider  the  infinite  tandem  team;  suppose  that  it  performs  M-dry  hypothesis  testing  and  that 
.r;c  communication  messages  between  DMs  are  also  M-ary.  Then  define  the  following  likelihood 
ratios: 

j  for  ij  =  0,  1, ...,  A/-1  and  i  >j. 

Let  Aij(Y)  denote  the  range  of  the  possible  values  of  A,;<-).  The  generalization  of  Proposition  1  for 
the  case  of  M-ary  hypotheses  is: 
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PROPOSITION  2.  Consider  the  infinite  tandem  team  which  performs  M~ary  hypothesis  testing 
and  employs  M-ary  messages.  The  team  probability  of  error  is  bounded  away  from  zero,  for  any 
prior  probabilities,  if  and  only  if  there  exists  some  Bij  >  0  such  that: 

for  some  i,j  =  0,  1, ....  Af-1  and  i  >  j. 

It  is  easy  to  find  an  example  for  which  the  probability  of  error  is  bounded  away  from  zero  if 
the  conditions  are  violated  and  the  binary  proof  can  be  adapted  and  simulated  M(M  -  l)/2  times  to 
show  that  the  conditions  are  also  sufficient. 

In  [HC70]  an  ingenious  scheme  was  presented  (and  generalized  in  [K75])  demonstrating  that 
if  the  Markov  chain  is  constructed  with  one  more  node  than  the  number  of  the  discrete  hypotheses, 
then  there  exist  sets  of  transition  probabilities  that  will  enable  the  chain  to  converge  to  a  unique 
(true)  state.  This  idea  could  be  appropriately  adapted  to  our  hypothesis  testing  framework  so  that 
decision  rules  for  the  DMs  be  derived  for  the  infinite  tandem  team  to  always  achieve  zero 
probability  of  error  if  the  number  of  the  communication  messages  between  DMs  is  one  higher  than 
the  number  of  the  hypotheses. 

Our  results  are  true  if  the  probability  of  error  is  generalized  by  a  cost  function  whch  assigns 
different  costs  for  hypothesis  misclassification.  They  can  also  be  extended  to  teams  which  have 
more  general  acyclic  (tree)  architectures,  as  long  as  the  team  does  not  include  a  DM  who  receives 
an  infinite  number  of  messages  from  other  DMs  and  to  teams  whose  DMs  are  not  identical.  The 
proofs  are  variants  of  the  proof  of  Proposition  1. 

4.  THE  SUBOPTIMAL  INFINITE  TANDEM  TEAM 

The  non-linear  coupled  equations  of  (2)-(4)  are  very  hard  to  solve;  their  solution  does  not  have  to 
be  unique  and  their  computational  complexity  increases  exponentially  with  N.  Moreover,  as  was 
discussed  in  the  previous  section  and  will  be  verified  with  the  computer  simulations  of  section  5, 
when  the  conditions  of  Proposition  1  hold,  the  convergence  of  the  q7timal  team  probability  of  error 
to  zero  is  slow. 

REMARK.  This  is  not  true  for  the  cases  where  the  conditions  of  Proposition  1  do  not  hold.  In 
those  cases  the  convergence  to  the  optimal  probability  of  error  occurs  geometrically  fast  at  a  rate  of 
a/(a+l)2.  If  7)  =  1,  the  difference  in  probability  of  error  between  a  team  of  N  =  2k  +  1  DMs  and 
the  (assymptotically  optimal)  infinite  team  is: 
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(a^  +  a+ l)(a+ 1)  [(a+l)^] 


JL. 


for  k  =  0,  1,  2, 


For  the  above  reasons  it  is  worthwhile  to  suggest  the  following  suboptimal  decision  scheme 
which  has  two  important  properties:  its  computational  requirements  increase  linearly  with  N  and, 
under  slightly  more  restrictive  conditions  than  those  of  Proposition  1,  the  probability  of  error  goes 
to  zero  as  N-*  oo. 

Under  the  suboptimal  decision  scheme  each  DM  tries  to  minimize  the  probability  of  error  of  its 
personal  decision;  that  is  it  acts  as  if  it  was  the  last  DM  in  the  team.  Therefore,  this  is  a  se^sh 
decision  nile  since  each  DM  effectively  ignores  all  of  its  successors  in  the  team  and  instead  of 
optimizing  the  global  team  decision,  each  DM  tries  to  "optimize"  the  performance  (i.e.,  minimize 
the  probability  of  error)  of  its  own  decision.  Note  that  this  suboptimal  decision  scheme  can  be 
implemented  easily  and  efficiently  even  if  the  DMs  of  the  team  are  not  identical.  Formally,  the 
suboptimal  decision  rules  for  any  DMs  are  defined  as  the  following  likelihood  ratio  tests  with 
constant  thresholds  5: 


A(y„) 


ui=  1 

^(yi)  ^  T}  = 

Ui=0 

Un=0 


MA 


(9) 

(10) 


for  n  =  2, ...,  N  and  /  =  0,  1 


From  now  on  we  refer  to  the  decision  rules  just  introduced  as  the  "suboptimal  decision  rules" 
and  to  the  team  which  employs  them  the  "suboptimal  team." 

There  exists  one  more  attractive  attribute  of  this  decision  scheme  which  is  in  fact  the  primary 
reason  we  analyzed  it  One  of  the  more  intriguing  questions  of  wganizational  design  deals  with  the 
response  of  the  team  to  a  change  in  the  team  architecture.  How  does  the  team  react  to  the  addition 
or  deletion  of  a  DM?  If  a  change  occurs  in  the  team  when  the  optimal  decision  scheme  is 
implemented,  the  team  can  not  make  use  of  its  current  status  to  facilitate  the  computation  of  the  new 
optimal  decision  rules;  the  problem  needs  to  be  solved  again  from  the  beginning.  This  is  not  true 
under  the  suboptimal  decision  rule,  where  it  is  relatively  easy  for  the  team  to  adapt  to  such  a 
change.  The  reason  for  this  is  that  under  the  suboptimal  decision  rule,  the  DMs  behave  less  than 


5  Comparing  the  optimal  decision  rules  of  (6)-(8)  to  the  suboptimal  decision  rules  of  (9)  and  (10),  notice  that  the 
suboptimal  ones  are  decoupled. 
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team  members  and  more  like  individuals;  still  the  analysis  will  provide  some  insight  and  bounds  on 
the  optimal  team  performance.  The  main  result  of  this  section  follows. 

PROPOSITION  3.  Consider  a  tandem  team  which  consists  of  N  identical  DMs  and  performs 
binary  hypothesis  testing;  suppose  that  the  team  employs  the  suboptimal  decision  scheme.  Then, 
as  N  ^  oo,  the  team  will  achieve  zero  probability  of  error  wp.\,for  any  prior  probabilities,  if  and 
only  if  both  the  initial  slope  of  the  ROC  curve  of  the  individual  DM  is  irrfinite  and  its  final  slope  is 
zero. 

REMARK.  The  necessary  and  sufficient  conditions  of  Proposition  3  are  stricter  than  the  ones  of 
Proposition  1 ,  since  they  require  that  both  the  initial  slope  of  the  ROC  curve  be  infinite  and  the 
final  slope  be  zero,  instead  of  either  the  initial  slope  be  infinite  or  the  final  slope  be  zero. 


Figure  3.  A  ROC  Curve  with  Infinite  Initial  Slope 

Proof.  To  prove  the  only  if  pan  recall  from  Proposition  1  that  if  the  ROC  curve  of  the  individual 
DM  has  both  finite  initial  slope  and  non-zero  final  slope,  the  asymptotic  team  probability  of  error  is 
bounded  away  from  zero  even  if  the  optimal  decision  rules  are  employed;  therefore  in  that  case,  it 
is  bounded  away  from  zero  when  the  suboptimal  decision  rules  are  employed. 

Consider  the  case  where  either  the  initial  slope  is  infinite  or  the  final  slope  is  zero,  but  not 
both.  We  need  to  show  that  the  asymptotic  team  probability  of  error  under  the  suboptimal  decision 
rules  is  bounded  away  from  zero,  even  though  it  goes  to  zero  under  the  optimal  decision  rules  (as 
was  established  in  Proposition  1).  For  this  suppose  without  loss  of  generality  that  the  ROC  curve 
of  the  individual  DM  has  infinite  initial  slope  and  non-zero  final  slope;  then  consider  the  DM  whose 
ROC  curve  is  presented  in  Figure  3  along  with  the  underlying  probability  distributions  in  Table  2. 
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It  should  be  obvious  that  if  the  prior  probabilities  are  such  that  rj<l-e  the  optimal  decision  for 
every  DM  is  «  =  1  this  leads  to: 


;  for  n  =  1, 2,  3, ... 


Thus  also: 


The  proof  of  the  only  t/pan  is  now  complete. 


Table  2.  Probability  Distributions  for  the  DM  of  Figure  3 

The  proof  of  the  if  pan  consists  of  proposing  decision  rules  for  the  DMs  of  the  team  which 
will  result  in  a  zero  asymptotic  probability  of  error;  that  is,  it  will  be  shown  that  given  any  5  such 
that  1>  ^  >  0,  if  the  proposed  decision  rules  are  employed,  the  probability  of  error  can  be  made 
less  than  5  as  oo.  It  will  also  be  shown  that  the  proposed  decision  rules  are  indeed  the 
suboptimal  decision  rules.  The  detailed  proof  is  presented  in  the  appendix.  Q.E.D. 


is  also  easy  to  see  that  if  n  ^  l-t-e  then  the  suboptimal  decision  rules  coincide  with  the  optimal  decision  rules  and 

are; 


“lO'l) 


0  ;  yi  =  0 

1  ;  yi  -  1 


-  l) 


0  ;  yB»0  and  i=0 
1  ;  otherwise 


These  of  course  lead  to  /*(«»)  =  0  (Proposition  1). 


for  n  *  2,  3,  4,... 
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Let  vl(-)  denote  the  likelihood  ratio  of  y  the  observation  of  each  individual  DM  and  let  A(Y) 
denote  the  range  of  its  possible  values.  Then,  Proposition  3  can  also  be  stated  in  the  following 
equivalent  form; 

PROPOSITION  3a.  Consider  the  irrfinite  tandem  team  which  employs  the  suboptimal  decision 
rules  and  performs  binary  hypothesis  testing.  The  team  probability  of  error  is  bounded  away  from 
zero,  for  any  prior  probabilities,  tfand  only  if  there  exists  some  B>0  such  that  either: 

\og[A(Y)]<B 

or: 

MB  <  log[yl(y)]. 

Similarly,  for  the  A/-ary  hypothesis  testing  case.  Proposition  2  can  be  modified  as  follows: 

PROPOSITION  4.  Consider  the  infinite  tandem  team  which  employs  the  suboptimal  decision 
rules  and  performs  M-ary  hypothesis  testing.  The  team  probability  of  error  is  bounded  away  from 
zero,  for  any  prior  probabilities,  if  and  only  if  there  exists  some  Bij  >  0  such  that  either: 

10g[Ay<P)]<By 

or: 

MBij  <  log[Ay<ni 


for  some  ij  =  0,  1, ....  A/-1  and  i  >  j. 

It  is  easy  to  find  an  example  for  which  the  probability  of  error  is  bounded  away  from  zero  if 
the  condition  is  violated  and  the  binary  proof  may  be  adapted  to  show  that  the  conditions  are  also 
sufficient  Since  under  the  suboptimal  decision  scheme  each  DM  tries  to  minimize  his  personal 
probability  of  error,  it  does  not  make  sense  to  assign  to  each  DM  a  number  of  messages  different 
from  the  number  of  the  alternative  hypotheses.  Our  results  arc  true  if  the  probability  of  error  is 
generalized  by  a  cost  function  whch  assigns  different  costs  for  hypothesis  misclassification.  They 
may  be  extended  to  teams  with  more  general  acyclic  (tree)  architectures,  as  long  as  the  team  does 
not  include  a  DM  who  receives  messages  from  an  infinite  number  of  other  DMs.  Finally,  as  was 
mentioned  above,  they  can  also  be  applied  to  teams  whose  DMs  arc  not  identical.  The  proofs  are 
variants  of  the  proof  of  Proposition  3. 
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5.  NUMERICAL  RESULTS 

In  this  section  we  perform  numerical  studies  of  the  optimal  and  the  subopdmal  decisicm  rules. 
The  probability  distributions  of  the  observations  are  Gaussian  with  variance  <^  =  100;  under  Hq 
the  mean  is  /i©  =  0  and  under  H\  the  mean  is  -  10.  Note  that  in  this  case  the  initial  slope  of  the 
RCX^  curve  of  the  individual  DM  is  mo  =  •»  and  that  the  final  slope  is  mi  =0;  thus  the  team 
probability  of  error  should  go  to  zero  asymptotically  under  both  the  optimal  and  the  suboptimal 
decision  scheme,  according  to  the  theoretical  results  presented  above. 


loifn) 


Figure  4.  /**(10):  Probability  of  Error  for  a  Ten  DM  Team  {N  =  10)  vs.  T)  in  a  log.  scale 

In  Figure  4,  we  present  the  probability  of  error  for  the  centralized  case,  the  optimal  case  and 
the  suboptimal  case  for  a  team  consisting  of  N  =  10  DMs  as  a  function  of  the  threshold  T]  (namely 
the  prior  probabilities).  The  number  N  =  10  was  selected  because  it  was  shown  in  [P88]  that  it  is 
sufficient  for  a  team  to  achieve  performance  very  close  to  the  asymptotic  one,  i.e.,  as  N  «x»,  for  a 
special  class  of  problems.  Also,  note  that  for  rj  =  1  (i.e.,  equal  priors)  the  optimal  and  the 
suboptimal  decision  rules  achieve  identical  performance;  in  fact  the  suboptimal  decision  rules 
become  optimal  in  this  case.  It  is  interesting  to  note  that  the  as  the  prior  probabilities  become  very 
unequal  (the  minimum  prior  probability  is  less  than  0.333),  the  performance  of  both  decision 
schemes  again  becomes  roughly  equal  (though  never  exactly  equal). 


0  5  10  15  20  25  30  35  40  45  50 

N:  Number  of  DNs 

Figure  6.  Percentage  Deterioration  in  Performance 


In  Figure  5,  we  compare  the  performance  of  the  centralized  case,  the  optimal  case  and  the 
suboptimal  case  for  77  *  3  as  a  function  of  N,  the  number  of  DMs  in  the  team.  The  probability  of 
error  of  the  centralized  case  decreases  exponentially  to  zero.  On  the  other  hand,  under  both  the 
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other  rwo  decision  schemes  it  decreases  slowly  to  zero.  Finally,  observe  that  the  percentage 
deterioration  in  the  team  performance  when  the  team  changes  from  the  optimal  to  the  suboptimal 
decision  rules  reaches  a  steady-state  level  as  the  number  of  DMs  increases.  In  Figure  6  the 
percentage  deterioration  in  the  team  perfcvmance  is  presented  for  the  cases  of  77  =  1  (where  there  is 
no  deterioration  because  the  decision  rules  coincide,  as  was  mentioned  above),  r;  =  3  and  r;  s  9;  as 
77  increases  the  deterioration  in  performance  between  the  two  decision  schemes  also  increases. 

We  would  like  to  repeat  that  the  implementation  of  the  suboptimal  decision  rules  is  much 
easier  than  the  one  of  the  optimal  decision  rules.  Each  DM  of  the  team  needs  to  know  only  very 
little  about  the  rest  of  the  team  in  order  to  inclement  the  suboptimal  decision  rules;  for  example,  it 
does  not  need  to  know  anything  about  its  successors.  The  suboptimal  decision  rules  are  much  less 
rigid  and  can  be  easily  adapted  to  accommodate  for  changes  in  the  team;  also,  for  the  optimal 
decison  rules  the  computational  requirements  grow  exponentially  with  time,  while  for  the 
suboptimal  decision  rule  they  just  grow  linearly  with  N.  Thus,  depending  on  the  particular 
application  of  the  team  and  on  the  available  resources,  the  team  designer  has  to  evaluate  the  trade 
offs  and  decide  which  decisitm  rules  should  be  implemented. 
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APPENDIX 

Proof  of  L^mma  1.  By  induction  on  N.  It  is  trivial  to  confirm  that  it  is  true  for  the  case  ofN  - 
2.  To  prove  the  general  case  first  observe  that  since  the  problem  is  symmetric  with  respect  to  the 
two  hypotheses,  the  team  ROC  curve  will  be  symmetric  with  respect  to  the  line  Pp  =  -Pp  +  L 
Thus,  only  (5a),  (5b)  and  (5c)  need  to  be  proved.  For  this  consider  whether  N  is  odd  or  even;  then 
(5)  can  be  written  accordingly: 


CASE  A.  N  =  2k  forifc=  1,2,3,... 

(p^,pS)  »  (0.0) 


(11a) 
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fory=l,  2 . k  (11b) 


)  =  (l-P^^ 


,l-P 


2k- 

F 


6 


for;=l,  2 . k-\  (11c) 

for;  =1,2 . Ik  (lid) 


CASE  B.  N  =  Ik for  ik  =  1,  2,  3, ... 

{PIPd)  =  (0.0) 


for;  =  1,  2 . k 


(12b) 


for;=  1,  2, ..., /:  (12c) 

for;=l,2 . 2;k+l  (12d) 


Suppose  that  a  team  of  N  identical  DMs  has  a  ROC  curve  defined  by  (1 1)  ( (12) ).  Then  it  is  a 
matter  of  tedious  but  straightforwaid  algebra  to  show  that  adding  a  new  DM  to  the  team  will  yield  a 
new  team  whose  ROC  curve  will  be  given  by  (12)  ((11)  respectively). 
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Consider  only  the  case  where  N  =  2k  since  the  proof  for  the  case  where  »  2jk  +  1  is 
analogous;  the  ROC  curve  of  the  team  consists  of  the  (/*p,  Pp)  points  defined  by  (1 1)  for  t]  =  0, 1, 
....  2N-1.  The  new  DM  N+l  has  two  decision  rules  to  choose  from: 


(i).  M/v+i 


(ii).  us^i 


1  ;  =  1  and  yA/  =  1 

0  ;  otherwise 


0  ;  tfv  =  0  and  yw  =  0 
1  ;  otherwise 


Then,  if  decision  rule  (i).  is  en^jloyed: 


(13) 


and  if  decision  rule  (ii).  is  employed: 


(14) 


When  decision  rule  (i).  is  employed  the  point  (0,0)  yields  again  (0,0),  the  points  of  (lib) 
yield  the  points  of  (12b),  the  points  of  (1  Ic)  yield  the  first  (Jt-1)  points  of  (12c)  and  the  first  point 
of  (11c)  (i.e.,  the  point  corresponding  to  j  -  1)  yields  the  last  point  of  (12c)  (i.e.,  the  point 
corresponding  to  j  =  k).  Similarly,  the  points  of  (12d)  are  obtained  by  symmetry.  Thus  all  the 
points  of  ( 12)  can  be  obtained  by  the  team  of  A^+l  DMs. 

It  is  not  hard  to  verify  analytically  that  all  the  other  points  that  can  be  obtained  from  the  points 
of  (1 1)  and  the  two  decision  rules  will  never  lie  above  the  RCX^  curve  defined  by  (12).  Q.E.D, 


Proof  of  Lemma  2.  Again  distinguish  between  N  odd  and  even. 

CASE  A.  N^lk  fork  ^\,  2,  3, ... 

Note  two  facts;  first  that  (Pp~  Pp~ ')  is  given  by  (5b)  for  j  ^k  and  second  that  instead  of 
taking  the  limit  as  N  goes  to  infinity,  we  can  equivalendy  take  the  limit  ask*  N/2  goes  to  infinity. 
Thus: 
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*-i 


and  taldng  the  limit  as  k  goes  to  infinity: 

(  1  f  («•»•  1)^  (  a  f  (a+ 1)^  ^ 

va+1/  a^  +  a+1  ’  'a+l'  a?--¥a+\\ 


lim  P?~\Pd~'^)  = 


JL 


Jil 


+  a  +  1  +  a  +  1 

CASE  B.  N=2k+l  for  /k  =  1,  2,  3, ... 

This  time  (Pp~^,  Pq~  is  given  by  (5c)  for  j-k: 


(p^,  p^)  =  1  — fiL_  y  ( — — v  1 _ I—  y  I a V 


Taking  the  limit  as  k  goes  to  infinity: 


lim  (P^,Pj^)  = 


,  a  (a+1)^  . _ 1  (g+1)^ 


^"*"1  a^  +  a+1  a^  +  a+lJ 


± 


joi 


\a^  +  a+  1  ’  a^  +  a+ I 
From  (16)  and  (18),  we  conclude  that  the  Lemma  be  true.  QJ£.D. 


(15) 


(16) 


(17) 


(18) 


Proof  of  Lemma  3.  Since  the  points  of  (7b)  are  symmetric  to  the  points  of  (7a),  it  suffices  to 
prove  (7a).  Denote:  m  =  -  - 1  +y  .  Then  the  points  of  (7b)  can  be  written  as: 


Similarly,  denote:  m  =  - 


l£ 

2 


m  =  -l,-2 . -[^J  (19) 

+j  .  Then  the  points  of  (5c)  can  be  written  as: 
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m  =  -l.-2 . -f^l+1  (20) 


When  the  limit  is  taken  as  N-*  <»  the  summations  of  the  above  equations  are  constant  for  all 
finite  m;  in  fact  they  were  calculated  in  the  proof  of  Lemma  2.  Then  by  examining  separately  the 
cases  of  N  odd  and  N  even,  it  can  be  shown  that  (19)  and  (20)  can  be  written  in  the  form  of  (7a). 
Q.E.D. 


Proof  of  Proposition  1. 

STEP  1:  Choose  some  large  number  rf.  Then  consider  the  point  Poi^*))  of  the  ROC 

curve  of  the  individual  DM  which  has  slope  and  denote  by  eo(Tj*)  >  0  the  probability  of 
detecuon  at  that  point  (Figure  7).  Then  from  the  concavity  of  die  R(X)  curve: 

TJ*  PpiV*)  <  edri*)  ^  PFiri*)<^^  (21) 

Note  that  such  a  point  can  always  be  obtained  regardless  of  how  large  77*  is  because  of  the 
assumption  that  the  initial  slope  of  the  ROC  curve  is:  mo  = 

STEP  2:  For  some  integer  N*,  define  the  following  decision  rules  for  the  DMs  of  the  team: 

For  DM  1; 

Ml  =  7i(yi)  =  {  (22a) 


For  DM  n;  n^2,  3, ....  Af*: 

=  Tnfynt  Mu  _  i) 


(  0  ;  A(y^  ^Tj*  and  m„_i»0 
\  1  ;  odierwise 


(22b) 


For  DM  n;  n  -  /V*+l,  N*+2,  N*+3,  ... 


Mn  =  rn(yn,Un-l)  =  M«_l 


(22c) 
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Figure  7.  A  ROC  Curve  with  Infinite  Initial  Slope  (mo  = «») 

Let  us  elaborate  on  the  decision  rules  of  (22).  According  to  these  only  the  first  N*  DMs 
influence  the  decision  of  the  team.  A  decision  u,-  =  0  is  propagated  through  the  first  N*  DMs  of  the 
team  until  some  DM  n*  receives  an  observation  which  makes  it  decide  Un*  =  1-  In  that  case  the 
team  decision  will  be  ujv=  1;  otherwise  the  team  decision  will  be  =  0.  Note  that  since  vj*  was 
chosen  to  be  large,  there  is  a  very  small  probability  for  a  DM  n*  who  receives  Un*- 1  =  0  to  decide 
Un*  =  1  under  both  hypotheses,  but  if  it  does  its  observation  y«*  suggests  that  there  is  an 
overwhelming  probability  that  //i  be  the  correct  hypothesis. 

STEP  i;  If  the  decision  rules  of  the  previous  step  are  implemented  the  probability  of  detection  of 
the  team  is: 

Ph  =  l-(l-^(r?*)r  (23) 

In  order  to  make  the  team  probability  of  detection  greater  than  1-  8 : 

log(^ 

log(l-eo(rj*)) 


/’o  =  1- (l-fb(T;*)r  >  1-5  ^  N*  > 


(24) 
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STEP  4:  Similarly,  the  team  probability  of  false  alann  is: 


Then  from  (25)  and  (21): 


In  order  to  make  the  team  probability  of  false  alarm  smaller  than  S : 

'  I 


STEP  5:  To  show  that  an  N*  satisfying  both  (24)  and  (27)  indeed  exists,  recall  that  for  x  *  0: 

log(l+x)  -  X  (28) 

If  ri*  is  selected  sufficiently  large,  eo(’»7*)  is  very  close  to  zero  (Figure  7);  then  from  (24),  (27)  and 
(28),  the  integer  N*  has  to  satisfy: 


log(l  -  S) 

j,  ^n*) 


lodl- 


logd  -  S)  >  >  log(^  ,  iog(«^ 

_  SD(n*)  -  eo(n*)  log(  1  -  eo(n*)) 


eo(n*)  J 


log(^ 


Thus  by  choosing  77*  sufficiently  large,  which  can  be  done  because  of  the  assumption  m©  = «»,  an 
integer  satisfying  both  (24)  and  (27)  can  always  be  obtained. 

STEP  6:  If  the  decision  rules  of  Step  2  are  employed  by  the  team,  for  any  given  prior  probalities 
and  consequently  any  threshold  t]  -  P{Hq)IP{H\)  (which  is  not  to  be  confused  with  our  personal 
choise  of  large  number  t)*),  the  team  probability  of  error  is: 

/»*(oc)  =  <  -^5  +  -^8  =  5  (30) 

77+1^  n+l  ^+1 

Thus  for  any  given  5>  0,  the  infinite  team  probability  of  error  can  be  made  less  than  8.  Q.E.D. 
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Proof  of  Proposition  3. 

Denote  by  Pp  the  probability  of  false  alarm  and  by  Pq  the  probability  of  detection  of  the 
decision  of  the  nth  DM  of  the  team.  Then  (10)  can  be  written  in  the  following  form: 


Figure  8.  A  ROC  Curve  with  Infinite  Initial  Slope  and  Zero  Final  Slope  (mo  =  oo,  mi  =  0) 

STEP  1 :  Pick  some  large  number  r\*.  Then  consider  the  point  (P/Krj*),  Ppirj*))  of  the  ROC  curve 
of  the  individual  DM  which  has  slope  r;*  and  denote  by  edirf*)  >  0  the  probability  of  detection  at 
that  point  (Figure  8).  Then  from  the  concavity  of  the  ROC  curve: 

V*  Pf(i1*)  <  edV*)  Mr?*)  <  (32) 

T?* 

Note  that  such  a  point  can  always  be  obtained  regardless  of  how  large  r?*  is  because  of  the 
assumption  that  the  initial  slope  of  the  ROC  curve  is:  mo  = 
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STEP  2:  Similarly,  for  the  same  large  number  n*,  consider  the  point  [Pp{\lr]*),  PoiMVi*'^  oi  the 
ROC  curve  of  the  individual  DM  which  has  slope  Vrf*  and  denote  by  1  -Ciirj*)  the  probability  of 
false  alarm  at  that  point  (Figure  8).  Then  from  the  concavity  of  the  ROC  curve: 

^[(l-ei(n*))-l]+l  <  PoiVn*)  =>  PDiVri*)  >  (33) 

Note  that  such  a  point  can  always  be  obtained  regardless  of  how  large  t]*  is  because  of  the 
assumption  that  the  initial  slc^  of  the  ROC  curve:  mi  =  0. 


Figure  9.  The  ROC  Curves  of  the  Worse  DM  of  Step  3  and  of  the  Original  DM 


STEP  3:  Assume  without  loss  of  generality  (since  the  names  of  the  hypotheses  can  be 
interchanged)  that  the  decision  threshold  rj  satisfies: 


T1  > 


Cl(T7*) 

r 


eo(n*) 

V* 


-eiiv*) 


(34) 


Then  replace  every  DM  of  the  team  by  a  worse  DM  whose  ROC  curve  is  presented  in  Figure  9  and 
underlying  probability  distributions  are  presented  in  Table  3.  Steps  2-6  of  Proposition  1  can  now 
be  repeated  for  the  infinite  tandem  team  consisting  of  the  newly  defined  DMs  to  show  that  P*(«»)  = 
0,  but  for  the  sake  of  completeness  they  are  included  here  as  well. 
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\y 

H 

0 

i 

Ho 

,  co(n*) 
n* 

Hirf) 

n* 

Hi 

i-co(n*) 

co(n*) 

Table  3.  Probability  Distributions  for  DM  of  Figure  9 


STEP  4  :  For  some  integer  N*,  define  the  following  decisicm  rules  for  the  DMs  of  the  team: 


For  DM  1: 


Ml  =  )l(yi) 


0  ;  yi=0 
1  ;  >1  =  1 


(35a) 


For  DM  n\  n  =  2,  3, 

Mn  ~  Yn(yHf  ^n-l) 


I  0  ;  y«  =  0  and  «„_i  =0 
I  1  ;  otherwise 


(35b) 


For  DM  «;  n=  N*+l.  N*+2,  lV*+3,  ... 

Mn  =  Ufi  - 1)  —  Ufi~l 

These  may  be  equivalently  written  in  terms  of  likelihood  ratios  as  follows: 


For  DM  1: 


Ml  =  ^(yi) 


0  ;  A(yi)^Tj* 

T  ;  A(yi)>Tj* 


For  DM  n;  n  =  2,  3, ...,  A^*: 

M«  =  rn(yn,U„.i) 


0  ;  A(yn)  S  n*  and  Wn- 1  =  0 
1  ;  otherwise 


For  DM  n;  n  =  N*+l,  lV*+2,  N*+3,  ... 


(35c) 


(36a) 


(36b) 


Un  -  Yn(yn,Un-\)  *  M„.i 


(36c) 
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STEP  5:  It  is  easy  to  see  that  if  the  decision  rules  of  the  previous  step  are  implemented  the 
probability  of  detection  of  the  team  is: 

=  l-{l-£b(n*)r  (37) 


In  order  to  make  the  team  probability  of  detection  greater  than  1-5: 


Pd 


(38) 


STEP  6:  Similarly,  the  team  probability  of  false  alarm  is: 

P/  =  l-{l-PF{jf)f* 


(39) 


Then  from  (39)  and  (32): 


In  order  to  make  the  team  probaitility  of  false  alarm  smaller  than  S : 


Pr  < 


log(l  -  S) 


>  N* 


(41) 


STEP  7:  To  show  that  an  N*  satisfying  both  (38)  and  (41)  indeed  exists,  recall  that  if  rj*  is 
selected  sufficiently  large,  eo(Tj*)  is  very  close  to  zero  (Figure  8);  then  from  (28),  (38)  and  (40), 
the  integer  N*  has  to  satisfy: 


log(l  -  5) 

log(l  -  S) 

^  N*  i 

\ogiS) 

log(5) 

1 

_ _ t 

L  V*  . 

-^TT) 

log(l 

log(l  -  S) 


^  N*  k 


iog(5) 

fb(n*) 


(42) 


Thus  by  choosing  ri*  sufficiently  large,  which  can  be  done  because  of  the  assumption  mo  »  an 
integer  N*  satisfying  both  (38)  and  (41)  can  always  be  obtained. 
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STEP  8  :  If  the  decision  rules  of  Step  4  are  employed  by  the  team,  for  any  given  decision  threshold 
77  which  satisfies  (34)  (and  which  is  not  to  be  confused  with  our  personal  choise  of  large  number 
77*),  the  team  probability  of  error  is: 

/»«(oo)  =  -^Pl  +  — 1— (l-F^)  <  -^S  +  — =  S  (43) 

rj-^l  ^  77  +  1  "  77+1  7J+1 

Thus  for  any  given  5  >  0,  the  probability  of  error  of  the  infinite  team  which  consists  of  the  worse 
DMs  (of  Figure  9)  can  be  made  less  than  S-,  therefore,  the  probability  of  enor  of  the  infinite  team 
which  consists  of  the  original  (better)  DMs  can  be  made  less  dian  S. 


STEP  9:  What  remains  to  be  verified  is  that  the  decision  rules  of  Step  4  for  the  worse  DMs  (of 
Figure  9)  are  indeed  the  suboptimal  decision  rules  of  (9)  and  (10)  for  those  DMs. 

It  is  not  hard  to  verify  that,  for  DM  1,  the  suboptimal  decision  rule  of  (9)  and  the  proposed 
decision  mle  of  (35a)  are  identical.  Recall  that  77  was  assumed  to  satisfy  (34)  and  that  rj*  can  be 
selected  sufficiently  large.  Then; 


1  -65-^ 
n*  >  1}  >  - — li- 


I-Co 


(44) 


Then  it  should  be  clear  firom  Figure  7  that  the  decision  thresholds  for  both  decisitm  rules  coincide. 
To  show  this  for  the  other  DMs,  recall  that  under  the  decision  rules  of  Step  4 : 


(PP,P8)  = 


l-(l-€b(n*)r)  ;  n  =  l,2,...,N* 

•p  l-(l-«i,(77*)rj  ;  rt*7V*+l,A(*+2.1V*+3.... 


1-1- 


eo(ri*)] 

rf 


(45) 


Substituting  into  the  thresholds  of  (31); 


M?  = 


eb(n*)f 
n*  ) 
(i-£b(77*)r-^ 

(l-£h(r7*)r 


;  n  *  2,  3, ....  N  * 


;  n«lV*+l,A(*+2,A/*+3, 


(46) 
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1-1- 


Hi  = 


n — i ;  /I  =  2,3 N* 

l-(l-£b(»7*)r-‘ 


1-1- 


eo(Tt*)\ 


T} - - ^  ;  n  =  A^*+l.A^+2,iV*+3. 

l-(l-ft(Tr)r 


To  show  the  above  thresholds  are  indeed  the  thresholds  of  the  suboptinial  decition  rules,  we 
need  to  show  that: 

0  1^  ’  «  =  2,3....,iV* 

^  \>rj*  ;  n  =  A/*+l,iV*+2, ... 
and; 

Hi  ^  i  n  =  2.3.4,...  (49) 

.  eo(Tr) 

rj* 

For  this,  we  now  need  to  show  that  there  exists  s<Mne  integer  AH  satisfying  (48).  Since  we  want 
the  team  probability  of  oror  to  go  to  zero  assymptotically,  we  also  need  to  verify  that  AH  satisfies 
(42).  Recall  that  rj*  is  large;  then: 


Therefore,  it  suffices  to  show  that: 


l-=PT 


..0  'r  /  ^  ^  ^  'r  /  _  ..0 

~  ^71 - TTTwS'  ^  *r  >  f?- - '  7  -  IV 

(l-6o(T;*)r  (l-ei)(J7*)r~^ 


Taking  logarithms; 


(vjloj|l-^!lj-log(l-«Kl)*))  2  logj^j  > 

>  (W«-I)jlo||l-^^j-log(l-£t){Tr))  (52) 


Using  (28)  to  approximate: 
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This  can  be  rewritten  as: 


log| 
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(54) 


Therefore,  an  integer  N*  satisfying  (48)  indeed  exists.  Moreover,  for  rj*  sufficiently  large: 


^log(l-g) 


logl 
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(55) 


Thus,  this  integer  N*  also  satisfies  (42). 

Finally  to  show  that  (49)  holds,  observe  that  for  rj*  sufficiently  large  (which  implies  that 
eoir}*)  is  very  small),  apply  Taylor's  theorem  to  obtain  that,  for  all  n  =  2, 3, 4, ... 


^  ^  («-l)£b(T?*) 


JL  < 

ri*  ,  fipfyy*) 

n* 


(56) 


Thus,  the  decision  rules  of  Step  4  correspond  indeed  the  suboptimal  decision  rules,  for  the  integer 
N*  defined  by  (54).  Q.E.D. 


